Metaphoric Gestures: Towards Grounded Mental Spaces
نویسندگان
چکیده
Gestures are related to the mental states and unfolding processes of thought, reasoning and verbal language production. This is especially apparent in the case of metaphors and metaphoric gestures. For example, talking about the importance of an idea by calling it a big idea and gesturing to indicate that large size is a manifestation of the use of metaphors in language and gesture. We propose a computational model of the influence of conceptual metaphors on gestures that maps from mental state representations of ideas to their expression in concrete, physical metaphoric gestures. This model relies on conceptual primary metaphors to map the abstract elements of the mental space to concrete physical elements that can be conveyed with gestures.
منابع مشابه
Towards Learnable Gestures for Exploring Hierarchical Information Spaces at a Large Public Display
Large displays are fast entering the public spaces, and some are beginning to support interaction based on mid-air gestures. At present, there is no set of standard gestures for that interaction; so people need to draw on existing mental models to learn such interaction. As a step towards closing this gap, we present the design and evaluation of learnable gestures for exploring a hierarchical i...
متن کاملModulating the assessment of semantic speech–gesture relatedness via transcranial direct current stimulation of the left frontal cortex
BACKGROUND Co-verbal gestures are crucial for communication. Neuroimaging studies suggest that the left frontal lobe may be especially important for processing metaphoric co-verbal gestures. However, so far, the specific functional relevance of the left frontal lobe in metaphoric (abstract sentence content) co-verbal gesture processing compared to iconic (concrete sentence content) co-verbal ge...
متن کاملTemporal Expressions in Speech and Gesture
People use spatial metaphors to talk about temporal concepts. They also gesture frequently during speech. The characteristics of these gestures give information regarding the mental timelines people form to experience time. The present study investigates the expression of temporal concepts on a natural setting with Turkish speakers. We found that Turkish speakers used more metaphoric temporal p...
متن کاملSuperior temporal sulcus disconnectivity during processing of metaphoric gestures in schizophrenia.
The left superior temporal sulcus (STS) plays an important role in integrating audiovisual information and is functionally connected to disparate regions of the brain. For the integration of gesture information in an abstract sentence context (metaphoric gestures), intact connectivity between the left STS and the inferior frontal gyrus (IFG) should be important. Patients with schizophrenia have...
متن کاملMental Timeline in Persian Speakers’ Co-speech Gestures based on Lakoff and Johnson’s Conceptual Metaphor Theory
One of the introduced conceptual metaphors is the metaphor of "time as space". Time as an abstract concept is conceptualized by a concrete concept like space. This conceptualization of time is also reflected in co-speech gestures. In this research, we try to find out what dimension and direction the mental timeline has in co-speech gestures and under the influence of which one of the metaphoric...
متن کامل